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Abstract 

We present a stochastic neural automata in which 
activity fluctuations and synaptic intensities evolve 
at different temperature, the latter moving through 
a set of stored patterns. The network thus exhibits 
various retrieval phases, including one which de- 
picts continuous switching between attractors. The 
switching may be either random or more complex, 
depending on the system parameters values. 

1 Introduction and Model 

Understanding how the processing of information 
in neural media is influenced by the biophysical 
processes that take place at the synaptic level is an 
open question. In particular, the effect of synap- 
tic dynamics and noise on complex functions such 
as associative memory is not yet well understood. 
In relation to this, it has been reported that short 
term synaptic plasticity has a main role in the abil- 
ity of some systems to exhibit switching between 
stored memories. T The same behavior ensues as- 
suming dynamics of the neuron threshold to fire. [2] 
The origin of the switching mechanism seems in 
both cases at a sort of fatigue of the postsynap- 
tic neuron under repeated presynaptic simulation. 
This destabilizes the current attractor which may 
result in a transition to a new attractor. It would 



be interesting to put this on a more general per- 
spective concerning the role of noise in associative 
memory tasks. With this aim, we present in this 
paper a stochastic neural automata that involves 
two independent competing dynamics, one for neu- 
rons and the other for synapses. 

Consider N (binary) neuron variables, Si = ±1, 
any two of them linked by synapses of intensity 



1, . . . , iV. The interest is on the con- 
figurations S = {si} and W = {wij}. In order 
to have a well-defined reference, we assume that 
interactions are determined by the Hopfield en- 
ergy function. Furthermore, consistent with the 
observation that memory is a global dynamic phe- 
nomenon, we take the model dynamics determined 
at each time step by a single pattern, say /i. Con- 
sequently, H{S,W;t) = -lT,iT,j^iW'^jStSj with 
fi = fi{t) and assuming the Hebbian learning rule, 
for example, w^ - = jj^^^j, where, = ±1 are the 
variables that characterize the fj, pattern, one out of 
the P memorized ones, and fc is a proportionality 
constant. Therefore, each configuration W is un- 
ambiguously associated to a single fj,, and we write 
W = /i in the following. 

The above may be formulated by stating that 
the probability of any configuration (S,/i) evolves 
in discrete time according to 

P,+i (S, - 5] E T[(S, /i) I (S', (S', A^'), 

S' fj.' 

(1) 

where r[(S, /i)|(S', /x')] represents the probability 
of jumping from (S',//) to (S,/i). We explicitly 



consider here the case in which 



(5[m — m(S)]Pt+i(S, /i) satisfies 



T[(S,/.)|(S',m')] = T>;'[S\S'] X Tf (2) 

with Tq [S|S'] corresponding to Little dy- 
namics, i.e., parallel updating, so that 
ro^'[S|S'] = n,=i^o' Furthermore, 
t(;'[s',z] = *[/3oAi?f'(s^ s,; = is',)], where 
^(X) is an arbitrary function, except that it 
is taken to satisfy detailed balance (see Ref.p] 
for a discussion), f3o is an (inverse) tempera- 
ture parameter, and AiJ denotes the energy 
change brought about by the indicated tran- 
sition. For changes in the synapses, we take 
Tf[n\ii'] = *[/3iA7?S(^' ^ y)]. We also take 
EsE^7^[(S,M)l(S',/i')] = 1 for any (S',/i')- 
After some algebra, one has that Aff'^ {s[ 

= ±s9 = -fcer'(5. - - <^f/N) 

and AH^in' ^I) = -^kN[imf')^ - (m^')^], 
where m'^(S) = is the overlap between the 
current state S and pattern fj,. The factor N in 
AH^ appears because we assume global energy 
variations (i.e., all synapses in the configuration 
are attempted to be changed at each step) instead 
of the energy variation per site in AH^^ . 

This model differs essentially from apparently 
close proposals, e.g., E]- First, because it 
assumes the same time scale for changes in both 
S and /I. On the other hand, the choice here for 
T[(S, /i)|(S', //')] amounts to drive neurons activity 
and synaptic intensities by different temperature, 
(3q^ = To and = Ti, respectively. The case 
of our model with a single pattern is equivalent to 
the equilibrium Hopfield model with P — 1; for 
more than one pattern, however, new nonequilib- 
rium steady states ensue. This is closely due to the 
fact that T[(S, ^)|(S', ^')] does not satisfy detailed 
balance. 

In principle, one may estimate from how any 
observable F{S,fj,) evolves in time. The result is 
an equation (i^)t+i — ft{K, F), where K is the set 
of control parameters and (• • •) denotes statistical 
average with P(S, ^). Alternatively, one may be 
directly concerned with the time evolution for the 
probability of jumping in terms of the overlaps m = 
{to";/! = 1,...,P} . One has that Ilt+i{m, /.i) = 



nt+i(m,M) = J dm'^T[(m,/i)I(m',Ai')]nt(m',Ai')- 

(3) 
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Figure 1: Phase diagram showing three different 
phases. (F) Ferromagnetic, for To < ro(ri), with 
m 7^ and j = 0. The system has static associa- 
tive memory. (P) Paramagnetic, for To > Tq (Ti), with 
m = and j — 0, without any kind of associative 
memory. (O) Oscillatory, for T§{Ti) < To < T^{Ti), 
with m = 0, J 7^ and dynamic associative memory, 
e.g. there are jumps between patterns either uncorre- 
lated (0(//)) or time-correlated (0(7)), as explained 
in the main text. The transition between 0(J) and 
0{II) is discontinuous. Here, TV — 16384 and P = 3 
spatial-correlated patterns with 20% of average overlap 
between any two of them. 

This amounts to reduce the degrees of free- 
dom, from a number of order 2^ -|- 1 in (S,/i) 
to P + 1 in (m,/i). Dealing with this sort 
of coarse-grained master equation requires 
an exphcit expression for T[(m, ^)|(m', //)] 
which we take as §[/3iAi?™(^' -> 
^)]A;/(iqexp[iV$(/3o,m,m',q, //')]. Here, K. 
is a constant, and q is the conjugated momentum 
of m. Hence, /i and m evolve separately in 
time. Changes in /i, given m, are controlled by 
'^[/3i AiJ'"(/i' /i)], while m evolves according 
to the term J (iqexp[A^$(/3oni, m', q, /i')] with a 
fixed fi' . A justification of this equation and a 
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detailed study of its consequences will be reported 
elsewhere. |H] 

2 Simulations 

Here we report on some preliminary results of a 
Monte Carlo study of this model which reveals an 
intriguing situation. Different regimes are shown in 
Figure 1 (Left) depending on the values of temper- 
atures To and Ti. To distinguish between them, we 
introduce the overlap (m) and the total number of 
jumps (j); three regimes occur that are close to the 
ones reported in p. There is an oscillatory phase 
which is illustrated in Figure 1 (Right). The system 
in this case has associative memory, like in Hopfield 
model. However, this is here a dynamic process, in 
the sense that the system trapped in any attrac- 
tor corresponding with a pattern is able to jump to 
the other stored patterns. Because the probability 
of jumping depends on the neurons activity, this 
mechanism is, in general, a complex process. 
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Figure 2: Activity of neurons versus time for A'' = 100 
neurons and P — 4 patterns. Here, To = 0.9To and 
Ti — 1.69rf , where Tq and Tf are the corresponding 
critical values of temperatures. 

One might argue that these jumps are a finite 
size effect; it does not seem to be the case, how- 
ever. Similar jumping phenomena, apparently in- 
dependent of the size of the system, [H] have al- 
ready been described in kinetic Ising-like models 
in which disorder is homogeneous in space and 
varies with time, and mean-field solutions also ex- 
hibit these phenomena. Some finite-size effects 
are evident, however; the synaptic temperature, 
for instance, scales with size. In fact, we obtain 
T^/N = 0.0431 ± 0.0001 for N = 1024, 1600 and 



4096; consequently, we redefine /3i = f3iN from now 
on. 

A series of our computer experiments concerned 
N = 65536 and P = 6. In order to study in detail 
the oscillatory phase, it turned out convenient to 
look at time correlations. Therefore, we used corre- 
lated patterns, namely, there was an average over- 
lap of 20% between any two of the stored patterns. 
The goal was to detect non-trivial correlations be- 
tween jumps, so that we computed the time r^^ the 
system remains in pattern v before jumping to pat- 
tern 7; X]7=i '''•^■y — '''v is total time the system 
stays in pattern v. This reveals the existence of two 
different kinds of oscillatory behavior. One is such 
that Ti/^ ~ T, independent of v and 7. That is, the 
system stays the same time at each pattern, so that 
jumping behaves as a completely random process, 
without any time correlation. This is denoted by 
0(11) in Figure 1 {Left). Even more interesting is 
phase 0(1). As the probability of jumping between 
patterns is activity dependent, lowering Tq leads to 
non-trivial time correlations, namely, T^~f depends 
on both V and 7. We also observe that Tj^^ differs 
from T^ii. This peculiar behavior suggests one that 
some spatial temporal information may be coded 
in phase 0(1) . 




Figure 3: Probability distribution for the time the sys- 
tem stays in a pattern before jumping to another one 
in the phase 0(11). Inset: Tail for large events. 

In order to understand further these two differ- 
ent jumping mechanisms, we simulated for Tq = 
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{0.1,0.5, 1.1}, in units of T^, at fixed Ti = 1.36Tf. 
The resulting probability distribution of time av- 
eraged over V, P{t)i is shown in Figure 2. The 
data fit P(t) = Aexp{~BT^)T^ . This predicts that 
(r^)^ = ^7r^(T)^ which compared with our simula- 
tions gives relative errors of e(%) = {3.3,3.8, 11.2} 
for To = {0.1,0.5,1.1}, respectively. The error in- 
creases with To because the overlaps then tend to 
become too small and jumps are, consequently, not 
so well-defined. 

Also interesting is the average of time r before 
jumping, because diverging of (t) indicates that the 
overlap is stable and no jumps occur. The trial 
distribution above gives (r) = A/2B^. Therefore, 
B, which also enters the probability normalization 
as ^ = 4(i3'^/7r)^/^, indicates whether there are 
jumps {B 0) or not {B = Q). B measures the 
jumping frequency. 

It is also worth studying the tails of the distribu- 
tions for large events. This is illustrated in Figure 
2 (Inset) . One may argue that, as in Ref.^lOj for 
somewhat related phenomena, this tail is due to 
the superposition of many exponentials, each cor- 
responding to a well-defined type of jumping event. 
We are presently studying this possibility in detail. 
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